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Where there is quantum theory there is hope 

C^4 , Quoted from Joyce Carol Oates What I lived for 

CN 

"^3 ' Abstract 

Transmission of classical information using quantum objects such as polar- 
ized photons is studied. The classical (Shannon) channel capacity and its 
relation to quantum (von Neumann) channel capacity is investigated for 
q-i. various receiver arrangements. 

A quantum channel with transmission impairment caused by attenuation 
and random polarization noise is considered. It is shown that the maximal 
(von Neumann) capacity of such a channel can be realized by a simple symbol 
by symbol detector followed by a classical error correcting decoder. 

For an intensity limited optical channel capacity is achieved by on-off 
keying (OOK). The capacity per unit cost is shown to be 1 nat/photon = 
1.44 bit/photon, slightly larger than the 1 bit/photon obtained by orthogo- 
nal quantum signals. 



1 Introduction 

In his fundamental work [GJ A Mathematical Theory of Communications 
from 1948 Claude Shannon introduced the quantity 



H = - ^ Pi lo S Pi 



which he called "entropy". It plays a central role in information theory as 
a measure of information, choice and uncertainty. 
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Figure 1: 

Claude E. Shannon, MIT Course 6.575, April 17, 1961. 
Photo: Goran Einarsson 



Richard P. Feynman tells Q that Shannon adopted this term on the 
advice of John von Neumann, who declared that it would give him "... a 
great edge in debates because nobody really knows what entropy is anyway" . 

At MIT in the early 1960-ties Claude Shannon told me and the other 
students in Course 6.575 that he choose the name because his expression 
had the same form as that of entropy in statistical mechanics. He also 
said that he doubted that information theory has any physical relation to 
thermodynamics . 



2 



One of the principal works on quantum theory is Mathematische Grund- 
lagen der Quantenmechanik |J by Johann von Neumann published in Berlin 
1932, before he changed his first name to John. There he introduced the 
concept of quantum entropy 

S = -Spur([/lnC7) 

The motivation was of course thermodynamics, there was no information 
theory around at that time. 

More recently it has been shown by A. S. Holevo and others, that the 
von Neumann entropy S plays a fundamental role in quantum information 
theory just as the Shannon entropy H in classical information theory. 

Quantum Information Theory is an interesting and expanding field. The 
basic applications of classical information theory such as source coding, data 
compression and channel coding have counter parts in quantum theory. Most 
of today research is focused on coding and transmission of quantum states 
motivated by the connection to quantum computing. 

We deal here with transmission of classical information by quantum ob- 
jects. 



2 Basic Quantum Theory 



A pure quantum state is represented by a normalized vector in a Hilbert 
space. We consider polarized photons in a two-dimensional space. 
A 'kef lib) is a column vector 



a 
b 



with complex components a and b and normalization 

||V||=|a| 2 + H 2 = l 
The 'bra' is the complex transpose of \tp) i. e. the row vector 

m = [a* b*] 

An important feature of a Hilbert space is the scalar product (t/j\(p) called 
the 'braket'. For 



a 
b 



and \ip) 



c 
d 



the scalar product is 

(i/f\<p) = (¥#)* = a*c + b*d = (c*a + d*b)* 

A two-dimensional quantum state \ip) representing one bit of information 
and is called a qubit. 
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Consider polarized photons an let |0) denote the state of horizontal and 
|1) vertical polarization. These two states are orthogonal, i. e. their scalar 
product is equal to zero, and arbitrary polarization states can be expressed 
as a weighted sum of these. The state 

|^) = ^(|0) + |1)) 

denotes 45 degree polarization and 

\*h) = j 5 (\o)+m) 

is right hand side circular polarization. 

The scalar product between states plays an important role in the sequel. 
By direct calculations it is easily shown that (^i|0) = l/\/2 and (V"2|l) = 
j/V2. 

3 Communication of Classical Information 

3.1 Binary Signaling 

We consider the possibility of communicating classical information, i.e. or- 
dinary data expressed as binary digits 'one' and 'zero' utilizing quantum 
objects such as polarized photons. 

As an example let the transmitter produce photons in two polarization 
states | so) and shown in Fig. 

ko) = |o), \ S1 ) = -^(10) + |i» 

The transmitted signals have either horizontal or 45 degree polarization. 

The receiver determines which type of photon was sent by a suitable 
measuring device (receiver). As a first attempt let the receiver consist of a 
horizontally oriented polarization filter. 

A photon in state \sq) will pass the receiver filter with certainty while a 
photon in state |si) will pass with probability 

|<si|0>| 2 = 0.5 

This means that the communication system is equivalent to the discrete 
binary Z-channel, shown in Fig. |2[ 

The Shannon channel capacity of a memoryless discrete channel with 
input alphabet k = 0, 1, . . . ,K — 1 and output alphabet j = 0, 1, . . . , J — 1 
is equal to the maximum of the average mutual information between sender 
and receiver Q 
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1) 



Q(0)=3/5 




C N = 0.60 C s = 0.32 

Figure 2: 

Binary photon communication with horizontal polarization receiver. 

a) Transmitted states \so) and \s\). 

b) Resulting discrete binary Z-channel. 



The quantity Q(k) denotes the probability of input symbol k and P(j/k) 
is the transition probability between input symbol k and output symbol 
j. Channel capacity defined as I(X;Y) maximized over all possible input 
symbol probability assignments For a Z-channel with two input and output 
symbols C can be obtained by a straightforward optimization. A convenient 
way of evaluating C is to use the general expression for two-dimensional 
channels presented in ||. For the Z-channel in Fig. [2] the optimal input 
distribution is Q(0) = 3/5 and Q(l) = 2/5 reflecting that the input symbol 
k = is more reliable than the symbol k = 1 and should be used more 
frequently in the code achieving capacity. The numerical value is 

C s = 0.32 bit/photon 

A relevant question is whether the horizontally oriented polarization re- 
ceiver is the best possible choice. There is a better alternative. It has been 
shown § that a the filter orientation shown in Fig. || minimizes the prob- 
ability of making an incorrect decision. In this case it also maximizes the 
Shannon capacity. The resulting discrete channel is symmetric with 

C s = 1 - H(p) = 0.40 bit/photon 

where p is the transition probability and 

H(p) = — plogp — (1 — p) log(l — p) (2) 

is the binary entropy function. 



5 



1) 



Q(0)=l/2 



0.85 




S o. 




o 



a) 



b) 
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1 



Q(l)=l/2 



0.85 



Xo 



C N = 0.60 



C s = 0.40 



Figure 3: 



Binary photon communication with optimal polarization receiver. 

a) Transmitted states |so) and Receiver orientation xo an d Xi- 

b) Resulting discrete binary symmetric channel. 

3.1.1 POVM Receiver 

The discrete classical channels arrived at in the preceding section depend 
on the receiver configuration. The receivers in Fig. [2| - || perform simple 
quantum tests, they check if the received photon is in any of two orthogonal 
polarizations, which is the best that can be done operating in an isolated 
two dimensional Hilbert space. 

A more general type of measurement is a POVM (Positive Operator 
Valued Measure). In the present context it is accomplished by extending 
the original two-dimensional Hilbert space combining the received photon 
with a so called ancilla which is a photon in a known fixed state. The 
received photon and the ancilla represent four dimensions together, which 
makes a test between four orthogonal states possible. This way it is possible 
to test if so or si were transmitted. Such a decision can not be made with 
certainty and the receiver will now also produce a no decision output. 

The principle of a POVM receiver for two signals separated by 45 degrees 
is illustrated in Fig. |j. The idea is to create three orthogonal state vectors 
| a), | b) and |c) in the extended Hilbert space, such that the projections of 
two of them falls on the signal vectors |so) and |si). In the present situation 
it is not possible to project directly on these and the projections are made 
on the vectors |s~o) and |s~i) orthogonal to |so) and \s\). From the geometry 
follows 



with P = 7r/4. The output symbol probabilities when, say sq, is transmit- 
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Figure 4: 

Binary erasure channel generated by a POVM receiver. 

a) Transmitted states |so) an d together with the orthogonal 
POVM states |a), \b) and |c) in three dimensional space. 

b) Resulting discrete binary erasure channel, e = l/\/2. 



ted are given by the square correlations between |so) and \a), \b) and |c) 
respectively. 

P(a\s ) = \(a\s )\ 2 = \(a\s )(s \s )\ 2 = ) 
P(b\s ) = |(6| So )| 2 = K6|*i><ai|*o>| 2 = l-co8/3 \ 
P(c\s Q ) = 1-P(b\s ) = cos/3 J 

The receiver bases its decision on the projections in the original two-dimensional 
space making its measurements on the received polarized 

3.2 von Neumann Capacity 

The receivers in Fig. || - || make decisions on each received symbol sep- 
arately, they perform hard decisions. In general the channel capacity can 
be improved by making decisions based on a sequence of received symbols. 
Holevo showed that the capacity for transmission of classical information 
over a quantum channel is upper bounded by 

N 

C N = max {S(p) -^2q k S{p k )} (3) 
to} fc=i 
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The transmitter sends on of iV possible states characterized by their density 
matrices p{k). The states may be pure or mixed. State k has input prob- 
ability qk and p is the average density matrix p = YlkQkPk- The function 
S(p) is the von Neumann entropy 

S(p) = — tracejplog p} (4) 

It has recently been proved that the Holevo upper bound (||) actually de- 
fines capacity, i.e. it can be achieved. This result is known as the Holevo- 
Schumacher- Westmoreland (HSW) Theorem, see ||. 
For pure input states S(pk) = and (§) reduces to 



max S(p) 

ilk} 



(5) 



For the signal configuration in Fig. [2] the density matrices are 

Po = \so){so\ : 

and 



1 




Pi 



Equal input probabilities qo = q\ 



2 gives 



l f ^ 1 

^{Po + Pl) = J 



1 1 
1 1 



3 1 
1 1 



Substitution into (||) gives the von Neumann capacity for communication 
with two photons differing 45 degrees in polarization 

C N = 0.60 bit/photon 

The maximal value Cat can achieve is Cm = 1 which is obtained by orthog- 
onal signals, e.g. sq = |0) and s\ = |1). In this case Cs = Cn and the the 
limit of 1 bit per photon is reached in a trivial way. 



3.3 Ternary signaling 

There is no need to restrict the communication to binary transmission. The 
following example of a ternary quantum signal alphabet has been investi- 
gated by Peres and Wootters H and implemented by Clarke et al. |i0(| . The 
transmitted photon is on one of three symmetrical polarizations 120° apart 
shown in Fig. ||a. 

I*i> = |0> I 

1*2) = -!|0> + #|1» } 

m = -m-m) \ 
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1} 




Figure 5: 

Ternary signals. 

a) Transmitted states \s\), |sa) and (53). 

b) POVM vector projections parallel to the signals. 

c) POVM vector projections orthogonal to the signals. 
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The von Neumann capacity (|^) for this signal set is equal to the maximally 
possible CV = 1- 

A POVM receiver utilizing an ancilla photon, analogous to the one de- 



scribed in Section |3.1.1| is needed to be able to distinguish between the three 
transmitted alternatives. A natural choice is to let POVM projections fall 
on the input signals, which would correspond to a matched filter receiver 
in classical communication theory. The resulting discrete channel is shown 
in Fig. ||b. Its Shannon capacity is Cs = 0.33 bit/photon. This receiver 
maximizes the probability of detecting the correct signal. 

A better alternative, however, is to let the POVM projections be or- 
thogonal to the input signal. This results in the channel in Fig. [5]c with 
C s = 0.58 bit /photon. 

The Shannon capacity requires a maximization over the input symbol 
alphabet. One possibility is to refrain from the use of one of the input 
symbols, i.e. assign probability zero to it. In the present case the result 
is a binary channel with two signals separated by 120° or equivalently 60° 
in polarization. An optimum polarization receiver of the type illustrated in 
Fig. |3] generates a binary symmetric channel with p = 0.067 and a capacity 
Cs = 0.65 bit/photon. Which is a larger value than for the ternary signaling 
systems above and almost as good as the photon pair receiver below. 

An interesting alternative is to let the transmitted signals be a pair 
of photons with equal polarization. The input alphabet is restricted to 



|s 2 S2> 1 6) 



a) 




0.97 



b) 



\s3S3) 



\a) 




\sist) 



C N = 1.5/2 = 0.75 



C s = 1.37/2 = 0.68 



Figure 6: 

Ternary signals with photon pair transmission. 

a) Transmitted states and the orthogonal measurement 
directions \a), \b) and |c) in three dimensional space. 

b) Resulting discrete ternary channel. 
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the three alternatives |sisi) \s2S2) and IS3S3). The von Neumann capacity 
for this signal set is CV=1.5/2 = 0.75 bit/photon. It turns out that the 
transmitted state vectors are almost orthogonal in four-dimensional Hilbert 
space, see Fig. ^. The corresponding discrete ternary channel has Cs = 1.37 
corresponding to 0.68 bit/photon. No ancilla photon arrangement is needed 
in this receiver. 



3.4 Quantum Cryptography 

Quantum communication is limited by the fundamental fact that only or- 
thogonal quantum states can be distinguished reliably. In Quantum cryp- 
tography [11] the fundamental uncertainty of the outcome of a quantum 
measurement has been turned into an advantage. Secret information can be 
communicated safe against eavesdropping. 



3.5 Noisy channels 

So far we have assumed that an error free channels is available between 
transmitter and receiver. In practice communication signals are subjected to 
various types of impairment during transmission. In classical communication 
noise of different origin is almost always present and has to be included in 
the analysis. 



3.5.1 Attenuation 

An common feature in communication systems is signal attenuation. In 
quantum communication it means that photons or other signal elements are 
lost on their way from sender to receiver. Attenuation is usually expressed 
in dB and if an average fraction g is lost it corresponds to 



A = -101og(l - e) dB 

If the receiver works in synchronism with the transmitter it can determine 
when photons are missing and such an event constitutes an erasure. Erasures 
decrease the capacity of a binary symmetric channel by a factor 1 — e. As an 
example let e = 10 %, corresponding to A = 0.46 dB, the Shannon capacity 
for the 45° binary communication decreases from Cs = 0.40 to Cs = 0.36 
bit/photon. For a system using orthogonal polarizations, which would be 
error free in case of perfect detection, an attenuation A = 1 dB will reduce 
the capacity from Cs = 1 to Cs = 0.79 bit/photon. 



3.5.2 Polarization noise 

A more complicated kind of impairment is if the polarization of the photon is 
disturbed during transmission. If the polarization of the state \sq) is changed 
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by an angle ip during transmission the received density matrix becomes 



cos tp cos tp sin ip 
sin tp cos ip sin 2 ip 



When ip is random the received state is a mixed state with density ma- 
trix po = E{po(ip)}. For polarization noise with a probability density f(tp) 
symmetrical around <p = 



Po 



1-d 
d 



where 



jm 



sin ip dip 



(6) 



(7) 



The constant d depends on the shape of f(tp). For a distribution uniform 
between — A/2 and A/2 it is equal to d = (1 — (sin^4)/j4)/2 and for a 
Gaussian distribution with variance a 2 the quantity d = (1 — exp — 2a 2 )/ 2. 

We consider communication with orthogonal signals |so) = |0) and = 
|1). The received density matrix generated by p\ is 



Pi 



The average density matrix is 



d 
l-d 



(8) 



P= o(P0 = o 



1 

1 



and the von Neumann entropy (||) is S(p) = S = 1. The entropies for (||) 
and (|8|) are equal to So = Si = H(d) where H(d) is the binary entropy 
function (^). The von Neumann capacity (||) is 

C N = S-l(S + S 1 ) = l-H(d) 



For a fixed polarization deviation the system generates a binary symmetric 
channel (BSC) with transition probability p{<p) = sin 2 ip. For a memoryless 
channel with random p the capacity is determined by the average value p 
equal to d defined in (|7|). The Shannon capacity Cs = 1 — H(p) is, for this 
noisy quantum channel, equal to its von Neumann capacity CV. 

This means that a hard decision symbol by symbol receiver in combina- 
tion with a classical error correcting code is sufficient to achieve the ultimate 
capacity Cat of this noisy quantum channel. The choice of orthogonal trans- 
mitted signals is essential for this result. 

As an example of the effect of polarization noise let d = 0.1. The result- 
ing channel capacities are Cs = CV = 0.53 bit/photon. 
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4 Alternative modulation 



4.1 Pulse Position Modulation (PPM) 



Helstrom [15] suggests a quantum modulation scheme using M orthogonal 
states generated as longitudinal modes in an ideal laser. The signaling is 
done by exciting one of these modes into a coherent state. It is shown that 
the error probability goes to zero for increasing M, which means that the 
channel have infinite capacity. He remarks that 'the quantum-mechanical 
nature of signals themselves does not limit the information-carrying capacity 
of a coherent optical channel'. 

To cast some light on this seemingly impossible result consider a semi- 
classical model of optical communication, the Poisson channel. It models 
light as a random stream of photons characterized by the optical intensity 
j(t) fll4j| . The number of photons in a time interval — T has a Poisson 
distribution 

P(N = n) - 



tv. 



with mean value 



m 



j(t)dt 



In quantum terminology the light is in a coherent state. 

A set of M orthogonal optical signals is generated by dividing the trans- 
mission interval of duration T into M time slots each of width A = M/T. 
An pulse of limited optical energy E is transmitted in one of the time slots. 
This modulation format called Pulse Position Modulation (PPM) is shown 
in Fig ^a. for the ideal case with the background optical intensity 70 = 0. 
With this assumption, the only situation when a transmission error can oc- 



7i- 



a) 



b) 



7o 



M 




Figure 7: 

a) Optical pulse position modulation (PPM) with M time slots. 

b) Channel diagram for an ideal optical PPM channel with 70 = 0. 
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cur is when, due to the Poisson fluctuations, no photons are observed in the 
interval — T. The ideal PPM channel is equivalent to an M-ary erasure 
channel, shown in Fig [?]b. The probability for an erasure is 

P(N = 0) = e- m = e 

where m is the average number of transmitted photons. The capacity for 
the M-ary erasure channel is 

C = (1 — e) log M bit/transmission 



The channel capacity for optical PPM approaches oo when M — > oo. It 
can be shown [16| that this is true also when 70 > 0. In practice the time 
slots can not be made arbitrary small since optical bandwidth is limited. In 
PPM the optical pulses have optical intensity E/A which is assumed to be 
unlimited. 



4.2 On-Off Keying (OOK) 

For an optical system with constrained signal intensity 7 it has been proved 

[ 18 1 that on-off keying (OOK) is the optimal modulation format. 

With 7 < 71 the channel capacity, in natural units per second, is |jj"7| l, 18 j, 

71/(71-70) 



( , _ To /Ti 

To 



T0T1 



In 



Ti 1 w 
— nat/s 

To/ 



(9) 



The background optical intensity 70 
rent in the receiver photo detector. 
For the ideal case 70 = the expression reduces to 

C = 71 /e nat / s 



Ti - To 

typically represents the dark cur- 



(10) 



The maximal error free transmission capability, channel capacity, is usually 
expressed as information per unit time (bit/s or nat/s). An alternative 
measure is capacity per unit cost [^]. For optical transmission a natural 
cost function is the number of photons needed to reliably transmit one bit 
of information. 

The capacity @) is achieved when the 'on' symbol is used with proba- 
bility 

q To [l /tiW^-^_ 
Ti - To e VTo/ 

The average intensity of signal photons is 

lave = 9(71-70) photons/s 



1 



(11) 



(12) 
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Figure 8: 

Intensity limited binary optical system. 

Transmission efficiency expressed as unit cost (no. of photons) per bit. 



The capacity per unit cost in nat per photon becomes 



C p h = C/^ave nat/photon (13) 

Fig |8| shows the cost per bit i.e. ln(2)/C p f l as a function of 71 for a system 
with 70 = 1. The diagram is equivalent to Fig 1 in |2^| for an AWGN 
channel. For large 71 the capacity C p h approaches the asymptotic value 
1 nat/photon = 1.44 bit/photon. In Fig || the asymptotic value In 2 = 



1/1.44 is indicated. The symbol probability (11) is q = 1/e for 70 = and 



Cph = C/q = 1 nat/photon (14) 

for all values of 71 . 

The same limiting rate 1 nat/photon was obtained by J. R. Pierce [^] 
for a receiver with an ideal optical amplifier. 

The result (0) can be obtained directly from a general relation for chan- 
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nels with a zero-cost input symbol |22| j. 

D(P y \x=o\\Py\x=x) , ir v 

C = SUP -p: (15) 

where the supremum is over the input alphabet and P Y \x=x denotes the 
output distribtion given that the input is x. The quantity D(P\\Q) is the 
(Kullback-Liebler) divergence between the probability distributions P and 
Q, see and b[x] denotes the cost function, 

D(P||Q) = £p(s)log^ (16) 

x&X ^ {X> 

For the Z-channel is 

D = 1 • log — h ■ log = — logp = m (17) 

p 1 — p 

and 

C = -r-r = — = 1 nat/photon (18) 
o|xJ m 



Relation (15) differs from Theorem 3 in [B2| which seems to be incorrect. 



4.3 Limited Bandwidth 

The capacity (S) is achieved when the pulse width T goes to zero which 
means that an infinite system bandwidth is required. 

The following example illustrates that a transmission efficiency equal to 



(14) can be achieved by a band limited system. 

Consider on-off modulation with a finite pulse duration T corresponding 
to a system bandwidth of the order of R = 1/T. For simplicity we consider 
an ideal system with 70 = A receiver using symbol by symbol detection 
is equivalent to a Z-channel with transition probability p = e~ m , c. f. Fig. 
^. The parmeter m = 71 T is equal to the average number of photons in a 
received pulse. The mutual information between input and output for the 
channel is 

I(X; Y) = -q(l - p) lug + qplnp - (1 - q{l - p)) ln(l - q(l - p)) (19) 
The channel capacity is the maximal value of ( |l9| ) which is achieved for 

(_£_•) 

p\ 1—p > 



vi — p/ — ?V 1 — V 



1 + p Kl -p' — p 



(20) 



Fig |9| shows the capacity per (average) photon C p h = C/(q-m) as a function 
of m. The efficiency is decreasing with m and approaches its maximal value 

Cph = 1 nat/photon (21) 
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0.1 - 



' ' ' ' ' ' ' ' ' 1 

01 23456789 10 

m photons 
Figure 9: 

Transmission capacity in nat per photon as a function of m the average 
number of transmitted photons for an ideal (70 = 0) band limited (OOK) 
optical channel. 

when m goes to zero. 

The result is independent of the symbol rate R and thus of the system 
bandwidth. The capacity, however, is low in terms of the symbol rate. 

4.4 Entanglement-assisted communication 

A quantum property that has no counterpart in classical physics is quantum 
correlation (entanglement). Two entangled photons have features together 
that can not be attributed to the individual photons. Two photon in an 
entangled state 

h/>) = i(|00) + |ll)) 

will both be found in horizontal or both in vertical polarization when they 
are measured at separate locations. 

Entanglement exists over arbitrary distances but it can not be used for 
direct transmission of information. All information about an entangled pair 
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is contained in their joint density matrix, which is fixed from the beginning. 
Whatever kind of operation made on one of the photons can not be detected 
by any kind of measurement on the other photon. 

Quantum correlation, however, can be used in combination with clas- 
sical communication in entanglement-assisted communication |[^]. As an 
example communication of two bit of information between two parties Alice 
and Bob can be done in the following way. Alice prepare an entangled pair 
and send one of the photons to Bob who stores it unchanged. At a later 
time Alice operates on here photon positioning the pair into one of four 
orthogonal entangled states. She then sends her photon to Bob, with both 
photons available, can determine which state was prepared and thereby de- 
code two bit of information. Notice that Bob has received two photons and 
the transmission efficiency is one bit per photon. 

An esoteric use of entanglement for sharing information between three 
parties is presented in [13]. 

It has been suggested that entanglement may improve the von Neumann 
capacity (0) but this is still an open question. 
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